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INTERACTING MULTI-CLASS TRANSMISSIONS IN LARGE 
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The mean-field limit of a Markovian model describing the in- 
teraction of several classes of permanent connections in a network 
is analyzed. Each of the connections has a self-adaptive behavior in 
that its transmission rate along its route depends on the level of 
congestion of the nodes of the route. Since several classes of con- 
nections going through the nodes of the network are considered, an 
original mean-field result in a multi-class context is established. It is 
shown that, as the number of connections goes to infinity, the be- 
havior of the different classes of connections can be represented by 
the solution of an unusual nonlinear stochastic differential equation 
depending not only on the sample paths of the process, but also on 
its distribution. Existence and uniqueness results for the solutions of 
these equations are derived. Properties of their invariant distributions 
are investigated and it is shown that, under some natural assump- 
tions, they are determined by the solutions of a fixed-point equation 
in a finite-dimensional space. 

1. Introduction. Mathematical modeling of data transmission in com- 
munication networks has been the subject of an intense activity for some 
time now. For data transmission, the Internet network can be described as a 
very large distributed system with self-adaptive capabilities to the different 
congestion events that regularly occur at its numerous nodes. Various ap- 
proaches have been used in this respect: control theory, ordinary differential 
equations, Markov processes, optimization techniques and so on. For data 
transmission one can distinguish two levels of mathematical abstraction: 

(1) Packet level. For this approach, the self-adaptive behavior of the trans- 
mission protocols is analyzed. Packets are sent as long as no loss is de- 
tected and throughput grows linearly during that time. On the contrary 
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when a loss occurs, the throughput is sharply reduced by a multiplica- 
tion by some factor r < 1 (the constant 1/2 in general). This scheme is 
known as an Additive Increase and Multiplicative Decrease algorithm 
(AIMD). The congestion avoidance algorithm of the TCP protocol is an 
example of such a scheme. 

Ott, Kemperman and Mathis [27] is one of the early mathematical 
studies. In this setting, after a scaling with respect to the loss rate, 
Dumas, Guillemin and Robert [11] proves various limit theorems for 
the resulting processes. A fluid limit description of the stochastic evo- 
lution of the throughput of a connection can then be obtained through 
a Markov process whose infinitesimal generator is given by 

n(f)(x) = af'(x) + bx(f(rx)-f(x)) 

for / a C 1 -function from M + to M where a, b > and r £ (0,1). The 
constant a is the rate of linear increase and r is the multiplicative factor. 
A precise formulation of this procedure is detailed in Section 2. See 
Dumas, Guillemin and Robert [11] for a survey of the literature in this 
domain. See also Chafai, Malrieu and Paroux [9]. 
(2) Flow level. It consists of looking at the state of the network on a quite 
long time scale so that the self-adaptive procedures of data transmission 
in the Internet can be described as a variation of a processor-sharing 
discipline at the level of the network. A connection is seen as a fluid 
characterized by the throughput it achieves given the other competing 
flows. A possible mathematical formulation is via an optimization prob- 
lem: given J classes of connections, when there are Xj connections of 
class j € {1, ... , J}, the total throughput achieved by the connections of 
class j is given by Xj so that the vector (Xj) is a solution of 



J 



where A is the set of admissible throughputs which takes into account 
the capacity constraints of the network. The functions (Uj) are defined 
as utility functions; various expressions have been proposed for them. See 
Kelly, Maulloo and Tan [21], Massoulie [23] and Massoulie and Roberts 
[24] . Kelly and Williams [22] gives a heavy-traffic analysis of a network 
in such a context. See also Srikant [31] for a more detailed overview of 
these models. 

In this paper, the first approach, the fluid limit description of the stochas- 
tic evolution of the throughput of a connection, will be used to analyze the 
coexistence of numerous connections in a network with a general number 
of nodes. Up to now the stochastic models analyzed rigorously have consid- 
ered a single node carrying similar flows. In this context, some approximated 
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mean field analyses have been carried out for a single buffer receiving packets 
of a large number of connections (see, e.g., Adjih, Jacquet and Vvedenskaya 
[1] and Baccelli, McDonald and Reynier [3]). In particular, few rigorous, 
explicit, results have been obtained for models with several types of connec- 
tions (e.g., relating different couples of nodes) and describing the evolution 
of the state of the whole network. In the general context of stochastic net- 
works, mean-field approaches have been used in various situations notably by 
Dobrushin and his co-authors (see, e.g., Karpelevich, Pechersky and Suhov 
[20]). 

The simultaneous transmission of several classes of permanent connec- 
tions is analyzed here. A connection is described, via a fluid representation, 
introduced in Section 2 by its instantaneous throughput. A class of connec- 
tions is characterized by the set of nodes it uses and by the rate of increase 
of its throughput when no loss occurs. The connections interact as follows: 
the loss rate of a given connection depends on the congestion of the nodes 
it traverses. If a loss occurs for a connection, its throughput is multiplied 
by some factor less than 1. In particular, the throughput of a connection 
depends on the state of all the nodes it is using and therefore on the other 
connections traversing any of these nodes. 

Mean-field analysis of multi-class systems. The evolution of a large num- 
ber of connections divided into homogeneous classes will be considered. As 
it will be seen, a Markovian multi-class mean-field analysis has to be devel- 
oped to investigate the properties of these networks. In this setting, chaotic- 
ity (i.e., convergence in law to i.i.d. random variables) is a classical notion. 
For statistically indistinguishable objects, modeled by systems of exchange- 
able random variables, chaoticity is equivalent to the fact that the empir- 
ical measures satisfy a weak law of large numbers. Sznitman [33] develops 
compactness-uniqueness methods, as well as coupling methods between ex- 
changeable systems and an i.i.d. system which give stronger results. See also 
Meleard [26] and Graham [12, 13]. 

Many phenomena involve dissimilar objects, called particles, classified in 
a finite number of types, particles of a class being similar and numerous 
(see, e.g., Cercignani, Ulner and Pulvirenti [8] and the review papers Bel- 
lomo and Stocker [4], Graham [13], Grunfeld [16], Struckmaier [32]). Few 
convergence proofs for such multi-class systems exist, and most references 
directly use extensions of the limit equations for systems of identical parti- 
cles without further justification. Some coupling techniques, such as those 
in Graham and Meleard [15] and Graham [13], using representations of the 
past history by random graphs and trees, may apply to some multi-class 
systems, but the models considered here do not have the specific structure 
required. Graham [14] studies natural notions of multi-exchangeability and 
chaoticity, and one of its scopes is to enable the adaptation of Sznitman's 
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compactness-uniqueness methods to multi-class systems, but these methods 
will not be used here. 

Nonlinear stochastic differential equations. As it will be seen, the sample 
path of the evolution of the fluid representation of the throughput of a 
"typical" connection is converging to the solution of an unusual nonlinear 
SDE (stochastic differential equations) driven by Poisson processes. In a one- 
dimensional diffusion setting, the corresponding equation can be written as 

dX(t) = a[X(t),E(X(t))]M(dt) + m[X(t), E(X(t))] dt, t > 0, 

where (J\f(t)) is a Poisson process on IR + and a and m are sufficiently regular 
functions. If 4>(t) = K(X(t)) were some fixed function, the above equation 
would be a standard (nonhomogeneous) SDE with a solution (X(t)) such 
that the value of X(T) is a functional of the sample path of (M(s),s < T) 
and of (4>(s),s < T). But, since 4> is dependent on the distribution of X(t), 
the problem here is completely different. In a diffusion framework, existence 
results have been proved in Jourdain, Meleard and Woyczynski [19] and Be- 
nachour et al. [6] (see also Joudain and Malrieu [18] for further references and 
properties). In our case, existence and uniqueness results for the solution of 
the corresponding nonlinear SDE when Poisson processes are proved in Sec- 
tion 4. Moreover, in order to have sufficiently general initial conditions, that 
is, with a Gaussian tail distribution, for example, an important exponential 
estimate, relation (4.7), for these solutions is established. This inequality is 
a key ingredient to prove the main mean field convergence result and for 
the applications of the last section. Note that with deterministic initial con- 
ditions (or with a bounded support), the corresponding results would have 
been more straightforward to derive. 

Outline of the paper. The mean-field limit of a Markovian model describ- 
ing the interaction of K classes of permanent connections in a network with 
J nodes is analyzed. Each of the connections has a self-adaptive behavior in 
that its transmission rate along its route depends on the level of congestion 
of the nodes of the route. More formally, the state of a class k connection 
is given by its throughput, that is, some nonnegative number w k G M+, and 
the quantity uj of a node j G {1, . . . , J} is given as a weighted sum of all 
throughputs of the connections using this node. If w is the state of a class 
k connection, it increases linearly with slope a k (w,u) and jumps to r k w at 
rate b k (w, u) where u = (uj) is the weighted throughput vector and r G (0, 1) 
is the multiplicative factor. A sketch of the stochastic evolution of the nth 
class k connection, 1 < n < N k , can be given by a fluid description through 
the ordinary differential equation 

^r;Wk,n{t) = a k (w kin (t),u(t)) - (1 - r k )w k;n (t)b k (w k>n (t),u(t)), 
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where u(t) = (uj(t)) and, for 1 <j < J, 

K N k 
U i (*) = A 3 k W k,p(t) 



k=l p=l 



(see Section 3 for a more formal description). Related models are considered 
by Kelly, Maulloo and Tan [21]. 

Since several classes of connections going through the nodes of the net- 
work are considered, an original mean-field result in a multi-class context 
is established in the following context: for any 1 < k < K, the number Nk 
of class k connections goes to infinity such that Nk/(Ni + • • • + Nk) goes 
to pk- Due to the lack of symmetry, an extension to multi-class systems of 
the notion of chaoticity and of Sznitman's coupling methods is developed. 
It is shown that, in the mean-field limit, the asymptotic behavior of a "typ- 
ical" class k connection, 1 < k < K, can be represented by the solution of 
an unusual nonlinear stochastic differential equation ((W)-(t)),l < k < K) 
depending not only on the sample paths of the process, but also on its dis- 
tribution. The proof of the mean field convergence relies on the convergence 
of the vector (u(t)), and, more precisely, that the relation 



holds for any 1 < k < K where the upper index TV refers to (N\, . . . , Nk)- 

Existence and uniqueness results for the solutions ((Wfc(i)), 1 < k < K) of 
these equations are established. Properties of their invariant distributions 
are investigated. It is shown, in particular, that for a quite large class of 
models the invariant distributions have an explicit expression given in terms 
of the solution of a fixed point equation in M.{_ . Several examples of networks 
are discussed. 

Section 2 recalls the main scaling results for the case of one class of connec- 
tions in a one node network, and Section 3 defines the model of the networks 
analyzed in this paper. The properties of the limiting process associated with 
the behavior of a given transmission are investigated in Section 4. In Sec- 
tion 5, convenient notions of exchangeability and chaoticity in a multi-class 
system are introduced and mean- field results are obtained in this context. 
Section 6 is devoted to the analysis of possible invariant distributions of the 
limiting process. 

2. A mathematical model of a single connection. This section introduces 
the mathematical framework used to describe the evolution of the transmis- 
sion rate of a single connection. In the following section, interactions of 
several connections within a network are presented and analyzed. 
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A connection between a source and a destination progressively increases 
its transmission rate until it receives some indication that the capacity along 
its path in the network is almost fully utilized. On the other hand, when 
congestion occurs, the throughput of the connection is drastically reduced. 
A given connection has a variable W which gives the maximum number 
of packets that can be transmitted without receiving any acknowledgment 
from the destination. The variable W is called the congestion window size. 
If all the W packets are successfully transmitted, then W is increased by 1 
(additive part of the AIMD algorithm) , so that W + 1 packets can be sent 
for the next round. Otherwise W is divided by some factor (multiplicative 
part of the AIMD). An AIMD algorithm can thus be described as follows: 



where [:rj is the integer part of x £ R. The randomness for this model is 
given by the sequence of events when losses occur. One of the simplest and 
most reasonable models to consider is that the loss probability of a packet 
is given by e and that losses occur independently for each packet. This is 
the model analyzed in Ott, Kemperman and Mathis [27] at the fluid level 
and by Dumas, Guillemin and Robert [11]. The questionable independence 
property of losses is discussed thoroughly in Guillemin [17] where it is shown 
that this assumption is in fact pessimistic in that it underestimates the real 
efficiency of the algorithm. 

A fluid picture. Under these assumptions, there is a natural Markov 
chain (W}Q whose transitions are given by (2.1). The variable can be 
interpreted as the "throughput" at the beginning of the (n + l)th cycle. 
For a given e > 0, little is known about the behavior of this Markov chain, 
about its invariant probability, for example. A scaling procedure has been 
developed in Dumas, Guillemin and Robert [11] consisting of looking at the 
continuous time Markov process 



It is shown that, as e goes to 0, the family of Markov processes (W £ (t), t > 0) 
converges in distribution to a Markov process (Wo(t),t > 0) whose infinites- 
imal generator is given by 



the instantaneous throughput of the connection at time t. Note that at this 
level, the "packet" description is not anymore valid since, in particular, one 
deal with a continuous state space. It is also proved that, as e goes to 0, the 



(2.1) 




W + l 

[rW\, 



if no loss occurs among the W packets, 
otherwise, 



{W £ {t)) = (V~eW[ m ). 
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invariant distribution of (Wq(£)) converges to the invariant distribution of 
(W (t)). 

The linear growth rate a of the throughput of the connection [the coef- 
ficient of f'(x) which is 1 in (2.2)] is related to the inverse of RTT 2 where 
RTT is the round trip time, the duration of transmission between the two 
nodes (see Section 3). It should be noted that the RTT has another effect 
which is not taken into account in this paper; it delays the dynamic so that 
the evolution at time t of a connection is a functional of the state of the 
network at time s, s 6 [t — RTT/2,t]. See Mc Donald and Reynier [25] for 
an analysis of this phenomenon in the case of a network with one node. 

In the following, a connection will be described as a Markov process sim- 
ilar to (Wo(t)). Since different classes of connections will be considered, 
several parameters have to be introduced, and a connection will be repre- 
sented as a Markov process (W(t)) whose infinitesimal generator is given 
by 

(2.3) U(f)(x) = af'(x) + bx(f(rx) - f(x)) 

for / a C 1 -function from R+ to M. For t > 0, the quantity W(t) should 
be thought as the instantaneous throughput of the connection at time t. 
As noted previously, its rate of increase a is related to the round trip time 
between the source and the destination. The variable b driving the loss rate 
will depend on the state of the nodes used by the connection. The quantities 
a, b and r will also depend on the class of the connection. 

The Markov process (W(t)) increases linearly at rate a, and, given that 
W(t) = x, it jumps at time t at rate bx from x to rx. As a stochastic process 
starting from x > 0, it can be represented as the solution (W(t)) of the 
following stochastic differential equation: W(0) =x and 

dW(t) =adt-(l- r)W(t-W([0, bW(t-)],dt) 

(2.4) 

= adt - (1 -r)W{t-) J l{o< x <bw(t-)}N(dx,dt), 

where M is a Poisson process on ]R^_ whose intensity measure is the Lebesgue 
measure on and W(t—) is the left limit of W at t (see Davis [10] and 
Robert [29]). 

If p = a/b and (V(t)) = ((W (t) / \fp)) , then the infinitesimal generator of 
(V(t)) is given by 

n v (f)(x) = ^-f'(x) + b^5x(f(rx) - f(x)) 

VP 

= Vab(f\x)+x(f(rx)-f(x))), 

which is proportional to the infinitesimal generator of (2.2). In particular, 
the invariant measure of (V(t)) and (Wo(t)) are, therefore, the same. The 
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density of the invariant distribution is given in the following proposition (see 
Dumas, Guillemin and Robert [11] and Guillemin, Robert and Zwart [17]). 

Proposition 2.1. If Wo is a random variable with density 

(2 5) H (x)~ V P/7T V - e -pr" 2 "x 2 /2 >n 

(2.5) H rA x) - n ^ (i _ r2n+1) ^ UU{1 _ r _ 2k) e , > 0, 

where p = a/b, then the solution of (2.4) with initial condition Wq having 
density H r>p , is a stationary process and its expected value is given by 

(2.6) E(Wo) = 
with 

V-(r) = V^IlTr^=r- 

n=l 

At equilibrium, the quantity K(Wo/y/e) can be seen as a first order ex- 
pansion (in e) of the asymptotic mean throughput of the connection. 

3. The stochastic model of the network. The network has J > 1 nodes 
and accommodates K > 1 classes of permanent connections. For 1 < k < K, 
the number of class k connections is > 1, one sets 

N=(N 1 ,...,N K ) and \N\ = JVi + • • • + N K . 

An allocation matrix A = (Aj^, l<j<J,l<k< K) with positive coef- 
ficients describes the use of nodes by the connections. If w n ^ > is the 
throughput of the nth class k connection, 1 < n < N/-, the quantity AjkW nj k 
is the weighted throughput at node j of this connection. A simple example 
would be to take Ajk = 1 or 0, according to whether a class k connection uses 
node j or not. The total weighted throughput Uj of node j by the various 
connections is given by 

K N k 

u j = ^2Yl A jk w n,k- 
fc=ln=l 

The quantity Uj represents the level of congestion of node j, and, in par- 
ticular, the loss rate of a connection going through it will depend on this 
variable. A closely related model has been proposed in Kelly, Maulloo and 
Tan [21] (see also Raghunathan and Kumar [28] in the context of wireless 
network) . 

More precisely, for 1 < k < K, the corresponding parameters a and b of 
(2.3) for a class k connection are given by functions a^ : R+ x M.{_ — > 
and frfc : K+ x — > M + , so that when the resource vector of the network is 
u = (uj , 1 < j < J) and if the state of a class k connection is : 
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(3.2) 



- its state increases linearly at rate a k (w k ,u); 

- a loss for this connection occurs at rate b k (w k ,u), and in this case its state 
jumps to r k w k . 

In view of (2.3), a natural form for these functions (with slight abuse of 
notation) is 

(3.1) a k (w k ,u) =a k {u) and b k (w k ,u) = w k j3 k {u). 

For example, one can take 

J 

(3k{u) = 5 k + ^2d jk (uj), 

3=1 

where T k > is the round trip time between source and destination and 5 k is 
the loss rate of class k connections in a noncongested network. For 1 < j '• < J, 
tjk(uj) is their delay at node j when the total weighted throughput is Uj. In 
particular, tj k (0) = and tj k (u) = when Aj k = 0. Similarly, dj k (uj) is the 
loss rate at node j, and it is when Aj k = 0. 

A Markovian representation. The Markov process describing the state 
of the ongoing connections is given by, for t > 0, 

W N (t) = (W% k (t), 1 < n < N k , 1 < k < K), 

where W^ k (t) is the state of the nth flow of class k at time t. 

As for (2.4), it can be represented by the solution of the following stochas- 
tic differential equation: for 1 < k < K and 1 < n < N k , 

dW* k {t) = a k (W% k (t-), U N (t-)) dt 

(3-3) 

- (1 -r k )W% k (t-) J l{0<z<b k (W» k (t-),U"(t-))}N n ,k( dz i dt ) 

with U N (t) = {Uf{t), 1 < j < J) and 

K N k 

k=l i=l 

where (A/" n fc, l<k<K,l<n< N k ) are independent Poisson processes on 
whose intensity measure is a Lebesgue measure on The following 
proposition is proved with standard arguments. 

Proposition 3.1. If, for 1 < k < K, the functions a k and b k are locally 
bounded, and a k is Lipschitz, then there is pathwise existence and uniqueness 
for a solution of stochastic differential equation (3.3). 
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Mean field scaling. Due to its high-dimensional state space, the system 
of coupled stochastic differential equations (3.3) does not seem to be math- 
ematically tractable as such. A scaling is used to investigate the qualitative 
properties of the corresponding Markov processes. It is assumed that for any 
1 < k < K, the number of class k connections N k goes to infinity so that 

1 1 \N\ ~ N 1 + ---+N K ^ Pk ' 

where pk > and p\ + • • • + px = 1 • 

The variable U N is accordingly scaled as U N = U /\N\ in the functions 
ak and bk so that (3.3) becomes the following: for 1 < k < K and 1 < n < Nk, 

dW» k (t) 

(3.5) =a k (W%k(t-),U N (t-))dt 

- (1 - r k )W% k (t-) J l {0 < z < bk{ w» k (t-),u"(t-))}Nn,k( dz ' dt ) 
with W{t) = (Uf(t), 1 < j < J) and 

1 K AT 1 Nk 

u?(t) d = f ±u»( t ) = £ g-A jk wnt) w^ wz® = j- e <*(*). 

k=l ' ' k n=l 

Note that there is a difference in (3.5) with the initial equation (3.3) since 
a factor 1/N has been introduced in functions ak and bk, 1 < k < K , with 
the term U N . This is a scaling procedure in order to get a nontrivial scaling 
limit when iV gets large. This amounts to scale the capacity of routers with 
the parameter N. This is a multi-class mean- field system with an interaction 
through the scaled weighted throughput vector (U N (t)). 

For 1 < k < K, it is natural to introduce the empirical measure for the 
stochastic processes associated to class k connections, 

k n=l 

where \ x (t),t>o) ^ s the Dirac mass at (x(t),t > 0). 

Notation and conventions. For x = (x m ) G M. M for some M G N, ||x|| 
denotes max(|a;. m | : 1 < m < M) and if z : M+ — > R M and T > 0, one defines 

|| z || T d = S up ||z(s)||. 

0<s<T 

Depending on the context the expressions 

(z m (t),l<m< M,t>0) or (z m (t), 1 < m < M) 
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are used for the function (z(t)). 

If if is a complete metric space, T>(M + ,H) denotes the Skorohod space of 
functions with values in H, continuous on the right and with left limits at 
any point of (see Billingsley [7]). The variable has values in the set 
7>(£>(R + ,IR + )) of probability distributions on P(R+,R+). 

4. Analysis of the nonlinear limiting process. In view of (3.5), because 
of the symmetry properties within each class of connection, it is natural to 
expect a mean-field convergence phenomenon to hold when N gets large. 
For 1 < k < K, the evolution of a typical class k connection should converge 
in law. More formally, the empirical measure A^ should converge in law to 
the distribution of a stochastic process (W(t)) = (\Wk{t), 1 < k < K],t > 0) 
solution of the nonlinear stochastic differential equation 

dW k (t) = a k (W k (t-),u w (t) ) dt 

(4.1) 

- (1 - r k )W k {t-) J l{o< z <b k (w k (t-),u w (t))}Nk(dz,dt) 

with uw{t) = (uw,j(t), 1 < j < J) and, for 1 <j < J, 

K 

uw,j(t) = Y. A 3kPkHW k (t)), 

k=l 

where (A4, 1 < k < K) are i.i.d. Poisson point processes on with Lebesgue 
characteristic measure. 

A nonlinear stochastic differential equation. In these equations, the in- 
teraction between coordinates of (W(t)) depends, in a nonlinear way, on the 
mean utilization vector (u(t)) which is a linear functional of mean values 
(K(Wk(t), 1 < k < K)). In particular, the infinitesimal generator of the pro- 
cess (W(t)) depends on the law of (W{t)) and not only on its sample path 
up to time t as it is usually the case. 

The properties of the solutions to (4.1) are analyzed in this section. The 
convergence results of the mean-field scaling are the subject of Section 5. 

Nonlinear martingale problems. Throughout this section, the natural fil- 
tration (JF() used to investigate the solutions (W(t)) to (4.1) is defined as 
follows: for t > 0, Tt is the a-field defined by 

T t = a{N k {A x B) : 1 < k < K, A G B(R+),B G B([0,t])), 

where B(H) is the space of Borel sets of H and M{A x B) is the number of 
points of the point process M in A x B. The elementary lemma will be used 
in the following. 



12 C. GRAHAM AND P. ROBERT 

Lemma. If (Y(t)) and (Z(t)) G P(M + ,R + ) are adapted processes to the 
filtration (J r t), then 

(l z (t)) = (£j Y{s-)l mz < z{s ^ } [N(dz,ds)-dzds]\ 

Y{s-)[M{[0,Z(s-)],ds) - Z(s)ds] 
is a local (J- 1) -martingale. 



o 



Proof. By localization with a stopping time, (Y(t)) and (Z(t)) can be 
assumed to be uniformly bounded by some constant C. 

If, for T > 0, (Z(t), <t<T) has a finite set V of possible values, then, 
for t < T, 

J *(*) = E /V( S -)l {z(s _ )=j;} (A/([0,i;],d S )-7;d S ). 

v&V J ° 

The classical properties of Poisson processes show that the martingale prop- 
erty holds on [0, T] for each term of the sum in the above expression and 
consequently for the process Iz- 

Returning to the general case, since 

sup \I z (t)\<C(Af([0,C\ x [0,T]) + CT) 

0<t<T 

by approximating (Z(t),0 < t < T) from below by processes with a finite 
number of possible values, and by using Lebesgue's theorem, one obtains 
the desired martingale property. □ 

If W is a solution of (4.1), for 1 < k < K, t>0 and / is a C 1 -function 
from R_|_ to K, by defining 

Mi(t)=f(W k (t))-f(W k (0))- I a k (W k (s),u w (s))f'(W k ( S ))d S 
' 6fc(W fc (a) ) « w (a))(/(r fc W fc (s))-/(Wfc(s)))da, 



then (Ml(t)) is a local martingale. For C 1 -functions / and g and k I, 
the local martingales m[ and Mf are independent and the Doob-Meyer 
brackets are given by 

(M[) t = [ b k (W k (s),u w (s))(f(r k W k (s)) - f{W k {s))f ds 



(see Rogers and Williams [30]). 
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A nonlinear martingale problem formulation of (4.1), is that there ex- 
ists a probability P on the space V(R+,R$) of sample paths (W(t)) = 
((W k (t), 1 < k < K),t > 0), such that for any C 1 -function /, the process m[ 
defined by formula (4.2) is a local martingale for P. 

Existence and uniqueness results. The following proposition is the cen- 
tral technical result used to establish the existence and uniqueness of solu- 
tions of (4.1), as well as the mean-field convergence result. 

Proposition 4.1. Let the functions (a k ) be bounded, and (a k ) and (b k ) 
be Lipschitz. For any nonnegative continuous W^-valued function u = (u(t)) 
and any M.+ -valued random variable Xq, let 4>(Xq,u) = (X k (t)) denote the 
solution of the 

dX k (t)=a k (X k (t-),u(t))dt 

(£u) -{l-r k )X k {t-) 

x / X {o<z<b k {x k (t-),u(t))} N k {dz, dt), l<k<K, 

starting at (X k (0)) = Xq. Then, for any such functions u and u' and random 
variables Xq and Xq, 

E[\\<t>(Xo,u) - <t>(X o ,u')\\ t \X(0),X'(0)] 

(4-3) 

< [llXn -XAH + / C(s)||u-u'||,dsle to w, 



r -^oll+ / C(s)\\u-u'\\ s ds}e tc ^, 
Jo 



where C(t) = A(l + t + \\u\\t + \\Xq\\ + ||-Xoll) an d A is a constant depending 
only on the functions (a k ) and (bk). 

Proof. The quantity Lb [resp. L a ] denotes the maximum of the Lips- 
chitz constants for the function b k , [resp. a k ], 1 < k < K. Denote by (X k (t)) = 
(4>(X ,u)(t)) and (X' k (t)) = (cP(X',u')(t)). 

Note that, since the functions (a k ) are bounded, by some constant ||a||, 
say, any solution (Z(t)) of (£ u ) satisfies the relation 

(4.4) Z k (t) < Z k (0) + \\a\\t. 

The quantity E°(-) will refer to the conditional expectation given X(0) and 
X'(0). For t>0, 

\\x k — Xk\\t 

<\X k (0)-X' k (0)\ 

(4.5) + [ \a k (X k ( S ),u(s))-a k (X' k (s),u'(s))\ds 
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+ Jo J l Xfe ( s_ )H*<&fc 

-X' k (s-)l {z < bkiX ' k (s~),u'(s))}\^'(dz,ds). 

By using the above lemma and the upper bound on (X k (t)) which shows that 
the local martingale of this lemma is indeed a martingale, the conditional 
expected value of the last term of this expression is given by 
rt 



E 



(4.6) 



< E 



\ X k{s)l{ z <b k (X k (s),u(s))} - X 'k{ s )^-{z<b k (X ' (s),u'(s))}\dzds 



\X k (s) - X k (s)\b k (X k (s),u(s))ds 



X' k (s)\b k (X k ( S ),u(s))-b k (X' k (s),u'(s))\ds 



E 



By using the growth conditions and the Lipschitz properties of (a k ) and 
(b k ), one gets that 

E°(\\X k -X' k \\ t )<\X k (0)-X' k (0)\ 



+ / Co(s)(\\u(s)-u'(s)\\+E (\\X k -X' k \\ s ))ds 



with 



K 



C {t) = L a + L b {2\\a\\t + ||u|| t ) + &fc(0,0) 



k=l 
J 



+ L b [X k (0)+X' k (0)] + ^L b Uj(0) 

i=i 

so that (Co(t)) can be replaced by (C(t)) as in the statement of the propo- 
sition. Gronwall's inequality gives the estimation 



E°(\\X k -X' k \\ t )< 



\X k (0)-X' k (0)\+ C(s)\\u(s)-u\s)\\ds 



< 



\X k (0)-X' k (p)\+ / C(s)\\u-u%ds 



J*C(s)ds 

tc(t) 



The proposition is complete. □ 



One of the main motivations of this study is to obtain results which 
are valid for functions (a k ) and (b k ) of the form (3.1) and (3.2) which have 
basically a quadratic behavior. To control the evolution of the vector (W(t)) 
and describe its stationary behavior, initial conditions cannot be assumed 
to be uniformly bounded; for this reason exponential and Gaussian moment 
assumptions are introduced. 
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Condition (C). It is said to hold for a family of random variables 
{Xq ,a G S} in M^, for {b k ), and for e > when at least one of the two 
conditions is satisfied: 

(1) For any 1 < k < K, the function b k '■ K + x Ri — ► M + is Lipschitz and the 
variables Xq, a£ S, have a uniform exponential moment of order e, 

supE(exp(e||^||)) < oo. 

(2) For any 1 < k < K , b k (w , u) = w(3k(u) and : — ► K+ is Lipschitz and 
the variables Xq, a £ S, have a uniform Gaussian moment of order e, 

sup E(exp(e||X^|| 2 )) < oo. 

The following theorem establishes the existence and uniqueness result of 
a solution of (4.1). 

Theorem 4.2. // the functions a k :R + x — > R + , I < k < K, are 
bounded and Lipschitz, and if Condition (C) holds for Wq, (b k ) and e > 0, 
i/ien i/iere is pathwise existence and uniqueness of a solution (W(t)) of the 
nonlinear stochastic differential equation (4-1) starting at Wq. 

In this case, the solution depends continuously on the initial condition in 
the following way: if(W(t)) and (W'(t)) are solutions of (4-1) with respective 
initial conditions Wq and Wq, having the same moment in Condition (C), 
for T > 0, there exists a constant At such that 

E(||W- W'\\ T ) 

(4.7) =E(sup||W(a)- W'{s)\\] 

< A T E(\\Wo - W-^le^ll^oir+ll^n^^ECoxpHlliEor+ll^inD^ 

where 1 = 1 or 2, depending on the moment in Condition (C), whether it is 
exponential or Gaussian. 

Proof. It is assumed for the moment that (1) of Condition (C) is sat- 
isfied. The functions (a k ) are bounded by the constant ||a||. Recall that for 
an integrable process (Z(t)) = (Z k (t)), for t > 0, 

uz(t) = (u Z j(t), 1 <j < J) = (j2A jkPk E(Z k (t)), 1 < j < A 

Let a denote the constant max(A,ipi + Aj2 P 2 + ■ — h AjkPk '■ 1 < j < J)- 
The sequence (W n ) is constructed by induction as follows: 



- W° = W(0); 
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- for n > 1, W n is the solution of (£ u ) (see Proposition 4.1) with W n (0) = 
W(0) and (u(t)) = (u W n-i(t)). 

Note that by the growth condition W n (t) < W n (0) + \\a\\t for t > and 
n > 1, and consequently, ||nvi/«||t < 0(11^(0)11 + ||a||i). With the notation 
of Proposition 4.1, W n = 4>(W(0),u W n-i) for n > 1, so that (4.3) gives the 
relation 



E[||W n+1 - WH| t |W(0)] < \ t C{s)\\u W n - u wn -i\\ s ds 

Uo 



e tc ^\ t>0, 



with C(t) = Aq(1 + 1 + 11^(0)11) where Ao is a constant depending only on 
(a k ) and (&&)■ Because of the assumption on the existence of an exponential 
moment for W(0), by taking t = e/(2A ), then 5 = aE(C(t ) exp(t C(t ))) < 
+oo. One gets that for t<to, 



ft 
Jo 



n> 1, 



so that 



(5t) n .. 

u W n+i — uw n \\t < — r~ Pw 1 ~~ u w° fa) ^ > 1, 



with relation (4.3). One gets, therefore, that 



E(\\W n+1 - W n \\ tn ) < 



(st y 



t () ) S , \\u\v 1 - u w°\\t 



holds almost surely. Consequently, the sequence of processes (W n (t),t < to) 
converges uniformly to some process (W(t),t < to) and 



(St ) n 



E(\\W n - W\\ t0 ) < ^J-e St ° \\u w i - u w o\\ to 



n 



The above relation also shows that on the interval [0,to] ? the sequence of 
functions (E(W n (t))) converges uniformly to (E(W(t))), and, in particular, 
(uw n (t)) converges uniformly to (uw(t)) on this interval. 
By definition of W n+l , for t<t and l<k<K, 

W£ +1 (t) = W k (0) + [ a k (W£(s),u W n(s))ds 
Jo 

- (1 - r k )W£(t-) [* M([OMW£(s-),u Wn (s))},ds), 



the uniform convergences, the Lipschitz assumption for a k and b k and con- 
tinuity properties of the Poisson process M k show that, almost surely, the 
limit {W{t)) indeed satisfies relation (4.1) on [0, to]. 
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If (W'(t)) is another solution of (4.1) with W'(0) = W(0), by using again 
relation (4.3), one gets that, for t < to, 

\\uw — uw' \\t < 5 / \\uw — uw'\\s ds 
Jo 

so that Uw = uw 1 on [0,io]> and, consequently, W = W on this interval. 

Since ||W(i )|| < ||W || + ||ap 0) Condition (C) holds for W(t ) and the 
same e > 0, by taking it as an initial condition and by translating the Poisson 
processes by to (on the second coordinate), one can show existence and 
uniqueness results on the time interval [to , 2ig] > and therefore by induction 
on R + . 

If (W(t)) and (W'(t)) are the solutions of (4.1) with respective initial 
conditions Wo and Wq, relation (4.3) gives that 

rt 



Ww — uw'\\t < oiE 



||Wb-Wg||+/ \\uw -u W i\\ s C(s)ds 



e tC(t) 



then, for t < to, by using again Gronwall's lemma, and the expression of C(t), 
one gets that there exists a constant A depending only on the functions (a^) 
and (bk) such that 

n\\u W - U W r\\ t ) < AE(\\W - ^||^(ll^ll + ll^||/2) )e E(cxp( e (||H/ || + ||^||))) 

for t < to- By plugging this inequality in relation (4.3), one gets a similar 
relation for E(||W — W'||t ). With the same procedure, an analogous inequal- 
ity can be obtained on the interval [0, nig] for any n > (with a constant A 
depending on n). The theorem has therefore been proved on M+ in case (1) 
of Condition (C). 

For the case (2) of Condition (C), when bk(w,u) =wf3k(u) and (3k is 
Lipschitz, the corresponding inequality (4.6) in this setting is the relation 

\X k {s)(3 k {u{s)) - X' k {s)f3 k {u'{s))\ 

< X k (s)\(3 k (u(s)) - P k (u'(s))\ + f3 k (u'( s ))\X k ( s ) - X' k (s)\ 

and the rest of the proof is analogous. The supplementary multiplication by 
W k (s) of the Lipschitz bounds is handled by the Gaussian moment assump- 
tion. □ 



5. The mean-field limit for converging initial data. In this section, the 
convergence results to the limiting stochastic process analyzed in Section 
4 are established. In the context of mean-field convergence, the notions of 
exchangeability and chaoticity play a fundamental role. If they are classical 
in the context of single-class systems (see, e.g., Aldous [2]), these properties 
have to be extended to investigate the stochastic model of the multi-class 
network considered in this paper. 
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Definition. The sequence of random variables (X n>k , 1 < n < N k , 1 < 
k < K) is said to be multi- exchangeable if its law is invariant under permu- 
tation of the indexes within the classes: for 1 < k < K and any permutations 
a k of {1, . . . , N k }, the equality in distribution 

(X ak(n)tk , 1 < n < N k , 1 < k < K) d = (X n>k , l<n<N k ,l<k<K) 
holds. 

A sequence (X^ k , 1 < n < N k , 1 < k < K) of multi-class random variables 

indexed by N = (N k ) £ N K is P\ ® • ■ • <8> Pk -multi- chaotic if, for any m > 1, 
the convergence in distribution 

lim (X% k , l<n<m,l<k<K) d = Pf m ® ■ • ■ ® P| m 

holds for the topology of uniform convergence on compact sets, where 
for 1 < k < K is a probability distribution on M + and with the convention 
that ./V goes to infinity when min^ N k goes to infinity. 

If a sequence of random variables is multi-chaotic, then any fixed finite 
sub-system is asymptotically independent with particles of class k having 
the law P k . 

An interesting result, not used in this paper, is that a sequence of multi-ex- 
changeable multi-class systems is multi-chaotic if and only if the restriction 
to each class is chaotic. See Theorem 3 in Graham [14]. 

Mean field scaling: Initial conditions and definitions. Equation (3.4) de- 
fines the growth rate of the number of class k connections when the total 
number of connections goes to infinity, one denotes 

M N = min N k , 

l<k<K 

and the terminology U N goes to infinity" refers to the fact that M N con- 
verges to infinity. Additionally, it will be assumed that the initial conditions 
of SDE (3.5), 

(W% k (0),l<n<N k ,l<k<K), 

are multi-exchangeable and P^o <8> • ■ • <S> Pk, o-multi-chaotic where, for 1 < 
k < K, P k: Q is a probability distribution on M + . The process (W^ k (t)) is the 

solution of (3.5) in this setting. For iV £ and n < M , one defines 
W»(t) = (W% k (t),l<k<K). 

Note that, because of exchangeability, (W£(t),t > 0) and (Wf(t),t > 0) 
have the same distribution, and, because of multi-chaoticity, the variable 
Wj^O) converges in distribution to P^o (8> • ■ • <S> Pk,o as M N goes to infinity. 
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The following theorem is the main result for the mean-field convergence. 
The underlying topology on the corresponding functional space is the uni- 
form convergence on compact sets. 

Theorem 5.1. Under the conditions: 

(1) for\<k<K, 

j£$ ooNi + ... + Nk =p>>> 

(2) the variables (Wj^ k (0), 1 < n < N k , 1 < k < K) are multi- exchangeable 
and P\fi <8) • • • <8) PRfl-^ulti- chaotic; 

(3) the functions a k '■ M+ x — > R + , 1 < k < J, are bounded and Lipschitz, 
and Condition (C) holds for the random variables {Wi {ti),N G N^} ; 
(b k ) and e > 0; 

then, for 1 < k < K , 

N k 

lim E' 

AT— »+oo 

and the sequence of processes 

•N 



" n=l 



0. 



((W£ k (t),t> 0),l<n<N k ,l<k< K), 

and the solutions of SDE (3.5) with initial conditions (W^ k (0)), is multi- 
exchangeable and Pw -multi- chaotic where P\y = P\Vi <H> • • • ® P\V K is the dis- 
tribution of the process (W(t),t> 0) = ((W k (t),t> 0),1 < k < K), the solu- 
tion of the nonlinear SDE (4-1) with initial distribution Pi o &> • ■ • <8> Pr,o- 

In particular, for any n > 1, (W*(t),t> 0) = ((W* k (t), 1< k<K),t>0) 
converges in distribution to (W(t),t > 0) as N goes to infinity. 



Proof. We prove the result assuming that b k is Lipschitz. The other 
case is similar (see, e.g., the end of the proof of Theorem 4.2). A coupling 
method will be used. 

Let (V^(t)) = ((Vf k (t),l <k<K)) be the solution of (4.1) with the 

initial conditions of the process (W^(t)), 

V n N (0) = (V n N k (0), 1 < k < K) = (Wi(0), 1 < k < K) = W»(0) 

and Poisson processes (J\f n ,k, 1 < k < K) driving the dynamic are the same 
as for (W*(t)) in (3.5). 

The key result to prove the theorem is to prove that the processes (W^f(t)) 
and (V^(t)) are asymptotically close, that is, for any T > and n > 1, 

(5.1) lim l(sup \\W?(t)-V»(t)\\)=0. 
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Because of the multi-exchangeability property, one has to consider only 
the case n = 1. With the notation of Proposition 4.1, one has = (^(W^ (0), u 
by definition of Vf , and Wf = <p(Wf (0),U N (t)) by (3.5). By taking X = 
Xq = Wj^O), u = u v n, and u' = U , and the expectation of inequality (4.3) 
with respect to the Poisson processes {M n .k, 1 < k < K, n ^ 1), gives 



E 



N 



(5.2) 



sup||Wf (s)-Vf(s) 

s<t 



<C»(t)e c ?W / E N (\\U N (s)-u ViN (s)\\)ds, 



where E Ar (-) denotes the expectation conditionally on the random vector 
Wf{0), and, since the function (a k ) is bounded by some ||a||, 



(5.3) V£ k (t)<V£ k (0)+t\\a\\ = W{! k (0)+t\\a\\, l<k<K,t>0, 

and C± (t) can be taken as ^4(1 + 11^1^(0)11 + t), for some constant A de- 
pending only on the functions (a k ) and (b k ). 

We hereafter cope with the lack of symmetry of multi-exchangeable sys- 
tems, whereas similar proofs exploit the strength of full exchangeability. 

It is assumed that pk > for all 1 < k < K for ease of presentation (the 
proof extends easily), then, for t > 0, 



J K 



(5.4) K N (\\U N (t) - u vf (t)\\) < E E AjkM 

j=i k=i 

with, for 1 < k < K, 



N 



and 



(5.5) 



with 



E 



N 



W(*) = ^E<^) 

fc n=l 



^Wf(t)-p fc E(Vft(t)) 



\N\ 



<Pk^ 



N 



N k 



n=l 



+ A?(i) 



iV/jA def 



1 Pk 

\N\ N k 



E 



N 



and, consequently, 



E <u(t) 

n=l 



lim EfsupAf (s)) =0 



< 



liVI 



E"ll< fc (t)l, 



iV->oo 
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due to the uniform integrability bounds on the initial data and the growth 
bound of the solutions of (3.5). 

The finite set {1, . . . , Nk} is partitioned into [Nk/M N \ consecutive subsets 
with M N elements and the remaining subset with cardinality R k <M N . 
Using again the multi-exchangeability property, one gets 



E 



N 



N k 



w T,l w nAt)-HVi N k(t))} 

fc 71=1 



(5.6) 



< 



N k 
M N 



M N . 



N, 



-E 



N 



M' 



M N 



J2Kk(t)-mi N k(t))} 



n.=i 



R N 

4vE[< fc (0-E(^(t))] 

U k n=l 



where 



E 



N 



1 



M 1 



< E 



N 



(5.7) 



vEW-W))] 

n=l 

1 M N 

m E( W nAt)-V n N k(t)) 
n=l 

1 M N 

-EM>))) 

M N 



+ E 



A? 



n=l 



<E-\W{\(t)-V- k (t)\+E N 
The Jensen inequality yields 



M N 



n=l 



E E 



N 



M N 



<E 



n=l 

AI N 



M N 



n=l 



and by developing the square, one gets 

M N 2 N 



E 



1 



M N 



T,[Vn N k(t)-mi N k (t))} 

n=l 
1 



E([^i(t)-E(Wi(t))n 



A' 
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M N — 1 

+ - 1 ^E([^(t)-E(^(t))][^(t)-E(y5(t))]), 

and by exchangeability, the covariance term of the last expression is given 
by 

mi N k(t)V 2 N k (t)) - 2E(F 1 »)E(F 1 ») + [E^t))] 2 . 
Hence the uniform integr ability bounds yield 



lim El supE^ 

N^oo \ \ s<t 



1 M N 



M N 

n=l 



2\ 



0. 



For the remainder term containing Rj^ in (5.6), two cases have to be con- 
sidered, 

/ R N i 

Rk<J\N\ lim-f = and R%>J\N\ => lim#f = oo, 

and the second case is treated as for M . Inequalities (5.4), (5.5), (5.6) and 
(5.7) yield 

E N \\u vf (t) -U N (t)\\ < £ E AjkPk® N \\VP(t) - W 1 N (t)\\+F N (t) 

i=ifc=i 



with 



(5.8) lim Elsup |F (s)| ) =0. 

By plugging this bound in inequality (5.2), one gets 
E N (\\W 1 N - VfWt) < Cf (t)e C ^ (a jfV(||Wf - Vfl) ds + F N (t) 

for some constant A > 0. The Gronwall lemma gives the relation 

E N (\\Wf - Vf\\ t ) < F N (t)C^(t)e c ^^exp(AtC^(t)e c ^^), 

the exponential moment assumption for the sequence (W^ (0), G N ) shows 
that, for t < to with to depending only on the functions (a^) and and 
e, the random var iables Cf (t) exp(Cf (t)t), N>1, are tight. Relation (5.8) 
implies, therefore, that the random variable E^(|| Vj^ — Wj^Ht) converges to 
in probability when N goes to infinity. The growth bounds (5.3) (also valid 
for Wi) and the uniform integrability property of (W-j^O), N S N ) show 
that the convergence to also holds for the expected value by Lebesgue's 
theorem. Relation (5.1) has therefore been established for t < to- The exten- 
sion to any arbitrary t is done as in the proof of Theorem 4.2. 
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The continuity property with respect to the initial conditions implied 
by relation (4.7) and the uniqueness result of Theorem 4.2 show that the 
sequence of processes (Vj^ k (t), 1 < n < Nk,l < k < K) is P\y = Pwi ® • ■ • <8> 
Pw K -multi-chaotic. Relation (5.1) gives that the same property also holds 
for the sequence of processes {W^ k (t), 1 < n < N^, 1 < k < K). The theorem 
is proved. □ 

The following corollary is an immediate consequence of the above result 
and of the exchangeability property. 

Corollary 5.2. Under the assumptions of Theorem 5.1 and if, for 
1 < k < K , Pw k is the distribution of (Wk(t)) such that the process (W(t)) = 
((Wfc(^))) 1 — k < K) is the solution of the nonlinear SDE (4-1) with initial 
distribution P±fi (g> • • • <g> Pk,o, then the convergence in distribution of the 
empirical distributions 

hm A% = P Wk 

N— >oo 

holds for the weak topology on V(T>(R+, with X>(R + ,R + ) endowed with 
the Skorohod topology. 

6. Fixed points and invariant distributions. This section investigates the 
stationary properties of the solutions of stochastic differential equations 
(4.1). Because of Poisson processes driving the corresponding random events, 
a solution (W(t)) of the system of (4.1) with some deterministic initial state 
clearly has the Markov property. Since the function (uw(t)) has a role in 
these equations, it will imply that, in general, the Markov property is nonho- 
mogeneous with time. In the martingale problem formulation, the analogue 
of the infinitesimal generator depends, a priori, not only on time but also on 
E(W(£)) which complicates a lot the analysis of the asymptotic behavior of 
the process (W(t)). See the remark above in Section 4. As the following the- 
orem shows, this has important implications, in particular, for the existence 
and uniqueness of an invariant distribution for (W(i)). 

Theorem 6.1. In the case where, for 1 < k < K, 

ak{w,u) = ak{u) and bk(w,u) = wf3k(u), «)>0,!i£Rj, 

f3k is a positive function and and b^ are Lipschitz functions and is 
bounded, then the invariant distributions for solutions (W(t)) of (4-1) are 
in one-to-one correspondence with the solutions u G of the fixed point 
equation 

(6.1) Uj = £ A 3kPk i,{r k )J^^ 1 < j < J, 

k=i V PkW 
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where 

1-2 +00 i_ r 2n 

^) = V-IIi— ^T- 

n=l 

If u* is such a solution, the corresponding invariant distribution has the 
density w ^Y\ k=l H rktPk (w k ) onM| where p k = a k {u*) / (5 k {u*) and H r>p is 
defined in Proposition 2.1. 

Proof. Let u* eR{bea solution of (6.1), and let W = (W ,k) G ^+ 
be a random variable such that, for 1 < k < K, Wo fe has the density (2.5) 
with a = a k (u*), b = (3 k {u*) and r = r k . By the invariance of this density (see 
Proposition 2.1), the solution (W k (t)) of the stochastic differential equation 

dW k (t) = a k (u*) dt-(l- r k )W k (t-)M k ([0, W k (t-)(3 k (u*)],dt) 

with initial condition W k (0) = Wo,fc> is a stationary process, in particular, 
for any t > 0, E(W k (t)) = E(W ,k) so that, for l<j<J, 

K K 

U w,j^ = J2 A 3kPk^(W k (t)) = J2 A jkPk ^{r k ) 

k=l k=l 

by (2.6) and (6.1) so that u^(t) = u* . This implies that the stochastic pro- 
cess (W k (t), 1 < k < K) satisfies (4.1). The variables Wq^ having a Gaussian 
moment, the above theorem shows that there exists a unique solution (W(t)) 
of (4.1) which is thus stationary and such that u\y(t) = u* . 

Conversely, if tt is a stationary distribution of (W(t)), then if the dis- 
tribution of W(0) is 7r, the quantity u*=uw{t) does not depend on t and, 
consequently, for 1 < k < K , the kth marginal of n is the invariant distribu- 
tion of the Markov process whose infinitesimal generator is given by 

n(f)(x) = a k (u*)f'(x) + x(3 k (u*)(f(rx) - f(x)). 

By Proposition 2.1, the density of the kih marginal of tt is necessarily H rktPk 
with p k = a k (u*) I ' (5 k {u*) , and u* satisfies (6.1). The proposition is proved. 
□ 

The above theorem shows that if the fixed point equation (6.1) has several 
solutions, then the limiting process (W(t)) has several invariant distribu- 
tions. Similarly, if (6.1) has no solution, then, in particular, (W(t)) cannot 
converge to an equilibrium. These possibilities have been suggested in the In- 
ternet literature through simulations, like the cyclic behavior of some nodes 
in the case of congestion. Obviously, there exist coefficients (a k ) and (f3 k ) 
with these possibilities for (6.1). Under mild and natural assumptions, such 
that if the loss rate at any node is increasing with its utilization, for some 
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networks there exists a unique fixed point. See the examples investigated 
below. 

Several special cases are now considered under the assumptions of The- 
orem 6.1. It is assumed that Aj k = 1 if node j £ {1, . . . , J} is used by con- 
nections of class k and otherwise. In the same way, for k € {1, . . . , K}, the 
function (3 k for the loss rate for class k connections depends only on the sum 
of the utilizations of the nodes used by these connections, that is, 



f3 k (u)=(3 k [ J2 A jkUj 




with a slight abuse of notation. Equation (6.1) becomes, in this context, 

K 

Uj = A jkPk^(rk) I j k 1 ^ 3 < J- 

k=l \J Pk(J2j=l A jkUj) 

It is assumed that u — > (3 k (u) is strictly nondecreasing and Lipschitz and that 
the function (afe(it)) is constant equal to afc. Let pk(u) denote a k / /3k{u). 

One single node. Here J = 1, for k £ {1, . . . ,K}, there is a unique solu- 
tion u = U to (6.1), 

K 

u=J2^(r k )pk ] 
k=i 



Pk(u) 



and consequently a unique invariant distribution for which the state of a class 
k connection has the density H r Pk and its expected value, the throughput, 
is 



In particular, if the effects of the congestion of the node on a connection are 
independent of its class, that is, (3 k = (3 for 1 < k < K , then, if the scaling 
factors {r k ) are equal, the throughputs of the different classes of connections 
differ by the multiplicative factors (y/ak). Recall that a k is typically pro- 
portional to the inverse of the round-trip time of a class k connection. See 
Figure 1. See Section 3. 

A linear network. A network with J nodes and J + 1 = K classes of 
connections is considered. For 1 < j < J, connections of class j uses only 
node j and the route of connections of class J + 1 go along the J nodes. 
This network has been considered in Ben Fred et al. [5]. In this context, 
(6.1) becomes 

(6-2) Uj =(^= + °™ A 1<j<J, 
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Fig. 1. A network with J nodes and J + 1 = K classes of connections. 



with ay = ip(rj)pj^/Oj, 1 < j < J+l and ||n|| = \u\\-\ H n >/I- For a > 0, the 



function (f>j, a (% 



def 



a/ J (5j{x) being strictly nondecreasing, the equation 



u ■ 



J 



has a unique solution f7. A solution (v,j) of (6.2) is necessarily given by 

aj+i 



1l: 



1 < j < J- 



Equation (6.2) has, therefore, a unique solution. 

Network on a torus. For this network, there are J nodes and K = J 
classes of connections, and class j € {1, . . . , J} uses two nodes: node j and 
j + l. The assumptions on the rate functions are the same as before. See 
Figure 2. For this network, (6.1) becomes 



(6.3) 



acj-i 



+ 



l<j<J, 



1 PjiUj-l+Uj) (3j+l(Uj + u j+1 ) 

with the convention that J + 1 = 1 and = J for the subscripts. For 1 < j < 
J, define ay = ip(rj)pj^/Oj and </y(a;) = 1/ J (3j(x). If ?/j = aj-\(f>j(uj-i + uj), 
then the above equation can be rewritten as follows: 

(6.4) j/j = aj-i</>j(yj-i + 2y^ + y j+ i), 1 < j < J. 

Take J = 3. Since, for 1 < j < J, <pj is strictly decreasing and continuous, for 
s > and a > 0, there exists unique Xj )Q (s) such that, ay ;Q (s) = a(j>j(xj ta (s) + 
s) and the function s — ► Xj >a (s) is strictly decreasing and continuous on M + . 
Similarly there exists a unique S > satisfying the relation 

# = (S) + x 2 , Q2 (5 1 ) + x 3>Q3 (5) . 

From this one sees that y = (xi t0li (S), 1 < i < 3) is the unique solution of 
(6.4). One concludes that (6.3) has also a unique solution. 
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